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1 Introduction 



Dynamic asset allocation in a stochastic paradigm received a lot of scrutiny lately. The pioneer 
works are [TS] and [TB]. Many works then followed, most of them assuming an exponential discount 
function. [7J has given an overview of the literature in the context of Merton portfolio management 
problem with exponential discounting. 

In this paper we consider a regime switching model for the financial market. This modeling 
is consistent with some cyclically observed in financial markets. Many papers consider these 
types of markets for pricing derivative securities. Here we recall only two such works, [10] and [9]. 
When it comes to optimal investment in regime switching markets we point to [1], [5] and [19J . 
All these papers consider a constant rate of time preference. 

In our paper the discount rate is stochastic, exogenous and depends on the regime. By 
the best of our knowledge it is the first work to consider stochastic rates of time preference 
within the Merton problem framework. In a discrete time model [18] considers a cyclical discount 
factor. Next we motivate this modeling approach of discount rates. The issue of time discounting 
is the subject of many studies in financial economics. Several papers stepped away from the 
exponential discounting modeling, and based on empirical and experimental evidence proposed 
different discount models. In fact models with time varying discount rates have a long history, 
going back to Bohm-Bawerk (1889) and Fisher (1930). More recent works like [3] and |llj show 
that economic and social factors impact discount rates. [T7] examins how the business cycles in 
the U.S. affects the rate of time preference. Therefore it appears natural to assume that discount 
rates vary with the state of economy (so are regime dependent). 

Non constant discount rates lead to time inconsistency of the decision maker. The resolution 
is to consider subgame perfect strategies. These are strategies which are optimal to implement 
now given that they will be implemented in the future. Ekeland and Lazrak [6] consider a de- 
terministic problem with continuous time, namely the Ramsey problem of economic growth with 
non-exponential discounting. They define subgame perfect strategies and characterize them by a 
generalized HJB (the non local extension of HJB). Ekeland and Pirvu [7] look at the Merton prob- 
lem with special types of non-constant deterministic discount rates, and introduced/characterize 
subgame perfect strategies. [8] extends [7J by allowing general non-constant deterministic dis- 
count rates and life insurance acquisition in their model. Related works are done in [12], [13] and 
|14| . [2] develops a general theory for stochastic control problems which are time inconsistent 
and introduced the subgame perfect subgame perefect tstrategies in a fairly general stochastic 
framework. Bjork, Murgoci and Zhou [3] look at the mean variance problem with time changing 
risk aversion which is also time inconsistent. 

In this paper, unlike previous works we consider a stochastic discount rates framework. The 
goal is to characterize the subgame perfect strategies. The methodology developed in [8] is 
employed to achieve this; it mixes the idea of value function (from the dynamic programming 
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principle) with the idea that in the future "optimal trading strategies" are to be implemented 
(from the maximum principle of Pontryagin). The new twist in our paper is the Markov chain, 
and the mathematical ingredient used is Ito's formula for the Markov-modulated diffusions. Thus, 
we obtain a system of four equations: first equation says that the value function is equal to 
the continuation utility of subgame perfect strategies; second equation is the wealth equation 
generated by subgame perfect strategies; the last two equations relate the value function to the 
subgame perfect strategies. The end result is a complicated system of PDEs, SDE and a nonlinear 
equation with a nonlocal term which can be solved for CRRA type utility. In this case we find an 
ansatz for the value function ( by disentangling the time, the space and the Markov chain state 
component). This leads to subgame perfect strategies which are time/state dependent and linear 
in wealth. If constant discount rates, we notice that subgame perfect strategies coincide with the 
optimal ones. In a remark we discuss the pre-commitment strategies; these are strategies that a 
decision maker would implement if there exists a commitment mechanism. 

Our contribution is to show that stochastic rates of time preference lead to time inconsistent 
optimal strategies. Moreover, our resolution is to characterize subgame perfect strategies which 
are a substitute for the optimal strategies within this context. The contributions of this paper 
are: first, to consider a model with stochastic discount rates, and for the special case of CRRA 
preference to compare by numerical experiments subgame perfect strategies and pre-commitment 
strategies. 

Numerical findings show the dependence on the model's parameters of the subgame perfect 
strategies and pre-commitment strategies. In one example we notice that a higher discount rate 
leads to a higher subgame perfect consumption rate; in another example we show that this is not 
the case if we allow the market parameters to switch. 

The reminder of this paper is organized as follow. In section 2 we describe the model and 
formulate the objective. Section 3 contains the main result. Section 4 considers the special case of 
CRRA preferences. Section 5 presents a numerical experiment. The paper ends with an appendix. 



2 The Model 

2.1 The Financial Market 

Consider a probability space (0, {J~t}o<t<Ti J~, P), which accommodates a standard Brownian 
motion W = {W(t),t > 0} and a homogeneous finite state continuous time Markov Chain (MC) 
J = {J(t),t > 0}. For simplicity assume that MC takes values in S = {0,1}. Our results hold 
true in the more general situation of S having finitely many states. The filtration {J~t}o<t<oo is 
the completed filtration generated by {^(i)}tg[o,oo) an d {J(t)}te[o,oo)-> 

that is F t = Fjyjf '. 

We assume that the stochastic processes W and J are independent. The MC J has a generator 
A = [Xij]sxS with Ajj > for i ^ j, and SjeS \j = for every i G S. 



3 



In our setup the financial market consists of a bank account B and a risky asset 5, that are 
traded continuously over a finite time horizon [0, T] (here T € (0, oo) is an exogenously given 
deterministic time). The price process of the bank account and risky asset are governed by the 
following Markov-modulated SDE: 

dB{t) = r(t,J(t))B(t)dt, 

dS(t) = S(t) [a(t, J(t)) dt + a(t, J(t)) dW(t)} , < t < oo, 

where B(Q) = 1 and 5(0) = s > are the initial prices. The functions r(t, i),a(t, i),a(t, i) : i 6 S, 
are assumed to be deterministic, positive and continuous in t. They represent the riskless rate, 
the stock return and the stock volatility (given the state i of the MC at t) . Moreover 

fj,(t, i) = a(t, i) — r(t, i) 

stands for the stock excess return. 

2.2 Investment-consumption strategies and wealth processes 

In our model, an investor continuously invests in the stock, bond and consumes. Let ir(t) be the 
dollar value invested in stock at time t and c(t) > be the consumption. X u (t) = X(t) represents 
the wealth of the investor at time t associated with the trading strategy u = (tt, c); it satisfies the 
following stochastic differential equation (SDE) 

dX u (t) = (r(t,J(t))X u (t)+ fi(t,J(t))ir(t) -c{t))dt + a(t,J(t))TT(t)dW{t), (2.1) 

where X(0) = x > is the initial wealth and Jo = i € S is the initial state. This SDE is called 
the self-financing condition. An acceptable investment-consumption strategy is defined below: 

Definition 2.1. An M. 2 -valued stochastic process {u(t) := (vr(t), c(t))}j e ro )00 ) is called an admis- 
sible strategy process and write u £ A if it is F t - progressively measurable and it satisfies the 
following integrability condition 

E[ \tt(s)h(s, J(s)) — c(s)| ds + / |7r(s)u(s, J{s))\ 2 ds] < co, a.s., for all ,t G [0, oo). (2.2) 
Jo Jo 

and 

X u (t) > 0, c(t) > 0, t G [0,T], Esup \U(c(s))\ < oo, E\U(X U (T))\ < oo. (2.3) 

{t<s<T} 

Here U is a utility function and is defined in the next subsection. 

Under the regularity condition (|2.2|) imposed on {n(t), c(t)} te ^ oo ^ above, the SDE (|2.1|) admits 
a unique strong solution. 
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2.3 The risk preferences 

A utility function U is a strictly increasing, strictly concave differentiable real-valued function 
defined on [0, oo) which satisfies the Inada conditions 

U'(0) = ]imU'(x) = oo, C/'(oo) = lim U'(x) = 0. (2.4) 

The strictly decreasing function U' maps (0, oo) onto (0, oo) and hence has a strictly decreasing 
inverse / : (0, oo) — > (0, oo). 

2.4 The discount rate 

As we mentioned in the introduction, this paper considers stochastic discount rates. An easy 
way to achieve this is to let the discount rate depend on the state of the MC. Thus, at some 
intermediate time t € [0, T] the discount rate is pj(t), for some positive constants po and p\. The 
intuition of this way of modeling discount rates stems from the connection between market states 
and discount rates (this can be explained by some models with endogenous discount rates which 
are influenced by economic factors). 

2.5 The Risk Criterion 

In our model, the investor decides what investment/consumption strategy to choose according to 
the expected utility risk criterion. Thus, investor's goal is to maximize utility of intertemporal 
consumption and final wealth. The novelty here is that we allow investor to update the risk 
criterion and to reconsider the optimal strategies she/he computed in the past. This will lead to a 
time inconsistent behaviour as we show below. Let the agent start with a given positive wealth x, 
and a given market state i, at some instant t. The t— optimal trading strategy {7ft (s), ct(s)} sG ^] 
is chosen to maximize the time t optimization criterion 



E 



-M s -*)[/(c(s)) ds + e- p ^ T -^U{X{T))\X{t) = x, J(t) = i 



(2.5) 



Throughout the paper we denote E^' 1 [] = E [| X(t) = x, J(t) = i] . The optimal t— trading strategy 
{TTt(s), ct(s)}se[t,T] i s derived by the supermartingale/martingale principle. In the following t 
stands for the initial time and s stands for the time to go, i.e., s € [t, T\. Let V(t, s, x,i) be the 
value function associated with maximizing the time t criterion 

sup E 

ueA 



J e - ft(s -' ) C/(c(s)) ds + e- ft(T "' ) [/(X(T))|X(t) = x, J{t) = 
This is characterized by the Hamilton-Jacobi-Bellman (HJB) equation 

(2.6) 



dV , 

— {t,s,x,i) +sup 

OS tx.C 



dV ,. .. . 1 2 2 d2y 



(rx + pir - c) — (t,s,x,i) + -a ir -^-(t,s,x,i) + U(c) 
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-PiV(t, s, x, i) + ^2 A ij^(*> s > x,j) = 0, 

with the boundary condition 

V(t,T,x,i) = U(x). (2.7) 

Here i stands for the value of MC at time t. Thus, the HJB depends on the current time t through 
and this dependence is inherited by the t— optimal trading strategy. This in turn leads to 
time inconsistencies. Let us detail on this; if at time the market state is 0, that is J(0) = 0, 
the HJB equation (|2.6p depends on po, leading to the corresponding time 0-optimal consumption 
strategy (which depends on po through the first order conditions) c p0 ; if at a later point in time 
t\ the market state is 1, that is J(t\) = 1, the HJB equation (12. 6h depends on pi, leading to 
the corresponding optimal consumption strategy (which depends on p\ through the first order 
conditions) c Pl ; The time inconsistency is due to the fact that time 0-optimal strategy fails to 
remain optimal, i.e., c p0 (t) ^ c pi (t) for t>t\. Notice that the value function V depends on two 
time points t and s. In the case of constant rate of time preference (po = p\ = p), the time 
optimization criterion is 



pT 

sup E 



and the time t optimization criterion is 



[ e~ ps U{c{s))ds + e- pT U(X{T))\X{0) = x, J(0) 
J o 



sup E 

ueA 



e 



-p(s-t)u(c(s))ds + e-" (r - 4) C/(X(T))|X(t) = x, J(t) 



Thus, the time 0-optimal strategy is also optimal for time t optimization criterion. This is no 
longer the case if po ^ Pi, and J(0) 7^ J(t)- 

One resolution of time inconsistency is to introduce subgame perfect strategies. They are 
optimal now given that they will be implemented in the future. 



3 The Main Result 



3.1 The subgame perfect trading strategies 



For an admissible strategy {u(t) = vr(t), c(t)} te [ 0i T] and its corresponding wealth process {^ n (t)}te[o,T] 
given by (|2.ip . we denote the expected utility functional by 



0(i, x, i, 7r, c) = 



( c (s)) ds + e- pi( - T - t) U(X v (T)) 



(3. 



Following [7j we shall give a rigorous mathematical formulation of the subgame perefect strategies 
in the formal definition below. 
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Definition 3.1. Let F = (Fi,F 2 ) : [0, T] x R + x S — > R + x S be a map such that for any t, x > 

and i £ 5 

ton inf 9(*.^».-P , i^2)-9(t,x,»,7r e>CE ) 
e4-0 e 

8(t,x,z,Fi,F 2 ) = e(t,x,«,7f,c), 

Tt(s)^F 1 (s,X(s),J(s)), c(s)±F 2 (s,X(s),J(s)), (3.10) 

and {tt(s), c(s)} sG r ti 7 i ] is admissible. Here, the process {X(s)} s ^t,T] is the wealth corresponding to 
{vr(s), c(s)} s6 [t ) r]. The process {ne(s) , Ce(s)} se[t,T] is another admissible investment- consumption 
strategy defined by 

7T e (s) = < (3.11) 

[7r(s), s e E e j, 

( \ sG[t,T]\^ t 
c e (s) = ^ (3.12) 
[c(s), seE e>t , 

with E e> t = [t,t + e]; {ir(s),c(s)} S £E €it * s an V trading strategy for which {ir e (s), c t (s)} s£ [ tt T] is an 
admissible strategy. If (j3.9|) holds true, then {tt(s),c(s)} s£ [^t] is a subgame perfect strategy. 

3.2 The value function 

Our goal is in a first step to characterize the subgame perfect strategies and then to find them 
in special cases. Inspired by [TJ, the value function v : [0,T] x R + x S — > M is a C 1,2 function, 
concave in the second variable defined by 

rT 



v(t, x,i) = E 



t 



e 



-p^- t )U(F 2 (s,X(s),J(s)))ds + e- p ^ T - t) U(X(T)) 



(3.13) 



Recall that {^(•s)} s gfo,T] is the wealth process corresponding to {tt(s), c(s)} se [t i r], so it solves the 
SDE 

dX(s) = [r(s,J(s))X(s) + ^(s,J(s))F 1 (s,X(s),J(s))-F 2 (s,X(s),J(s))]ds (3.14) 
+ a(s, J(s))F 1 (s,X(s))dW r (s). 

Moreover, F = (F\,F 2 ) is defined by 

F & X >Q = ~ ^SlT l \ > 4 f^(t,x > i) > ) , t € [0,T], (3.15) 

cT 2 (t,z)p(t,rr,i) V^x J 

(recall that I is the inverse marginal utility). Thus, the value function is characterized by a system 
of four equations: one integral equation with nonlocal term (|3.13p . one SDE (|3.14p and two PDEs 
(|3.15p . Of course the existence of such a function v satisfying the equations above is not a trivial 
issue. 



7 



Assumption 3.2. Assume that the PDE systems 

^(t,s,x,i) + (r(t,i)x + (j,(t,i)F 1 (t,x,i) - F 2 (t,x,i))^(t,s,x,i) 
+ a2{t, ' )F ^ t,X,l) ^(t, s, x, A*i/(t, s, x, j) = 0, f(t, t, x, i) = U(F 2 (t, x, 0) (3.16) 

dh dh 

— (i, x, i) + (r(t, i)x + i)Fi (t, x, i) - F 2 (t, x, *))^(*> x > 

+ fj2(t ' °^ (t ' *' g, «) + E 3) = 0, Mr,x,z) = C/(x). (3.17) 

/iaue a C 1 ' 2 solution on [0, s] x IR + X(S^M with exponential growth. Here t < s < T, and i € S. 
Moreover assume that the SDE (|3. 14[) has a solution and that {it (s), c(s)} sg [ <n given by ()3.10|) 
u>i£/i (Fi,F 2 ) o/ (|3.15p is admissible. 

In the light of this assumption and by the Feyman-Kac Theorem it follows that 
/(t, «, x, i) = p7(F 2 (s, J( S )))], x, i) = Ef[U(X(T))}. 

By (I3TT3]) 



v{t,x,i) = J e- p ^ s - t) f(t,s,x,i)ds + e- p ^ T - t) h(t,x,i). (3.18) 



Let us also define 



rT 

v(t,x,i)± / e- p i {s - t) f(t,s,x,i)ds + e- p > {T - t) h{t,x,i), i,j G 5. (3.19) 



The next Lemma expresses the integral equation fj3. 13f) as a system of PDEs. 

Lemma 3.3. The value function v solves the following system of PDEs (four equations) 

dv . , , , . „. , „. ^ <9t> . a 2 (t,i)F?(t,x,i) d 2 v , . . 

— (t, x, ») + (r(t, (t, ») -F 2 (t, x, t))fo(t, x, i) + 2 1V ' ' g^(t, *, *) (3-20) 

+[/(F 2 (i,x,i)) + \uv(t,x,i) - piv(t,x,i) = -\ijv(t,x,j), i,j € 5. 



<9u 9u a 2 (t,i)F?(t,x,i) d 2 v 

— {t, x, i) + (r(i, z)x+//(t, (t, x, i)-F 2 {t, x, &)) — (t, x, zj H ^ (i, x, zj (3.21) 

+£/(F 2 (i,x,z)) + Xuv(t,x,i) - pjv(t,x,i) = -Xijv(t,x,j), i,j € S. 

with the boundary condition v(T,x,i) = v(T,x,i) = U(x). 

Conversely if there exists a C 1,2 solution (v, v) on [0, T] x BL + x5->R with exponential growth 
for (I3T201) . ([3T2D . tfien u satisfies (l3~T3l) . 
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Proof: By differentiating (|3.18p with respect to t we get 

^(t, x,i) = J e ~ Ms ~ t] %(^ s > x > *) ds + e ~ Pl(T_t) ^^' x ' *) + P iV & x ' *) " *' x ' 0- ( 3 - 22 ) 
Moreover 

^ (*, i) = f g (t, a, x, i) + e -«CT-*) ^(t, s, <) . (3.23) 

«2 /-T o2 f o2l 

^(t,x) = jf e -«(-*)^(t lfl , a; ,i)cfa + e -«C r -*) s? (t, a! ,i). (3-24) 
In light of (I3~THD . (HTTP) . (I332D . IET531) and (^24~|) it follows that 

ft(t,x,i) + (r(t,i)x + p(t,i)F 1 (t,x,i) - F 2 {t,x,i)) — {t,x,i) + ^ ' ^ {t^x^i) 

+U(F 2 (t,x,i)) + Xuv(t,x,i) - piv(t,x,i) = -Xijv(t,x,j). 
Similarly we get the PDE for v. For the converse let us define 

r-T 



e 



-P('-*)Z7(F 2 (s, X(s), J(s))) ds + e-"( T - t) f/(X(T)) 

Then by Feyman-Kac Theorem it follows that 

v(t,x,i) = V(t,x,i,pi), v(t,x,i) = V(t,x,i,pj), i,j £ S, 

so u satisfies ()3.13p . 

The following Theorem states the central result of our paper. 



□ 



Theorem 3.4. Under Assumption ^. 1 the trading strategy {n(s), c(s)} sg [ 0j T] ffwen fry t|3.1Uj) wii/i 
(Fi,F 2 ) of (I3.15j) is a subgame perfect strategy. 



Proof: Let us define 



Tv(t,x,i) = ^(t,x,i) + (r(t,i)x-l(^(t,x,i)j\^(t,x,i) 



ftV^T^ + E X *Mt, x, i) - v(t, x,j)) + U(F 2 (t, x, i)). (3.25) 
^ ' > d^^ X ^ 1 ' j&S 
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T^ c v(t,x,i) = —(t,x,i) + (r(t,i)x-jj,(t,i)7r-c)—(t,x,i) 

1 d 2 v \ 

+ (M)tt 2 —-^(t,x,i) + 22\ij(v(t,x,i) - v(t,x,j)) + U(c). 



(3.26) 



By (HUD 



rv(t,z,i) = Xij(v(t,x,j) - v(t,x,j)), i,j e 5. 
The concavity of v and the first order conditions lead to 

Tv(t, x, i) = maxT n ' c v(t, x, i), (Fi(t, x, i), F 2 (t, x, i)) = argmaxr 7r ' c f (t, x, i). 

{tt,c} {ir,c} 



Let us recall that 



Thus 



@(t,x,i,Fi,F 2 ) = v(t,x,i). 



(3.27) 
(3.28) 



®(t,x,i,F 1 ,F 2 ) - Q(t,x,i,ir £ ,c e 



+ E? 



+ E 



-«(-*) [C /(F 2 ( S , X( S ), J( a ))) - U(c(s))] ds 



e -^ s - t )[U(F 2 (s,X( S ),J(s)))-U(c(s))}ds 



t+e 



-M T -*)([/(X(T))-[/(X(T))) 



(3.29) 



In the light of inequalities (|2.3|) and Dominated Convergence Theorem 



lim- 

e4.0 



E ,,i Ijt+^-Ms-^p^x^ J(s))) _ tf( c ( a ))] da 



U(F 2 (t,x,i) -U(c(t)). 



By (137281) it follows that 



E, 



-«(-*) [C/(j p 2 ( S) x (s)) J(s ))) _ f/(c(s)) ] ds 



(3.30) 



+ E 



X ■ I 

t 



-«( T -*)(£/(X(T))-£/(X(T))) 



E*'* + e, X(i + e), J(t + e)) - «(* + e, X(i + e), J(t + e))] 



+ E? 



+ E? 



E [ / ( e -«(-0 _ e -M* +£ )( s -*))[C/(F 2 ( s ,X( S ), J( S ))) - U(F 2 (s,X(s),J(s))))ds 



t+e 



^ e -pi(r-t) _ e -pj(i+«)(T-*+e))[i7(x(r)) - c/(x(r))] 



(3.31) 



By inequalities (12.3f) and Dominated Convergence Theorem it follows that 
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E, 



( e -ft(r-t) _ e -Pnt+e)( T -t+^))[U(X(T)) - U(X(T))] 



lim— 

= A ii (e-«f r -*) - e-^( T - t ))Ef' i [p/(X(T)) - 17(X(T))]] = 0. 
By the same token one can get that 



lim- 

40 



E x t ' 1 



JT (e -«(-*)_ e -^)(-*))[c/(F 2 ( S) X( S ),J( S )))-C/(F 2 ( S! X( S ),J( S )))]d S 



0. 



Ito's formula yields 

Ef [v(t + e,X(t + e),J(t + e))-v(t + e,X(t + e),J(t + e))] 



t+e 



t+e 



= Ef l J \Tv(s,X(s), J(s)) - U(F 2 (s,X(s), J(s))]ds - Et' 1 \ [T^ c v(s,X(s),J(s))-U(c(s))]ds, 
Therefore 

ejt,x,i,Fi,F 2 ) - e(t,x,i,ir £ ,Ce) - 

hm = [Fvit, x, i) — T ' u(r, a;, i)\ > 0, 

e|o e 

(the inequality follows from (|3.27P ). 

□ 



4 CRRA Preferences 



In this section we assume that the utility is of power type, i.e., U(x) = Uj(x) = Let us take 
advantage of the special form of the utility function to simplify the problem of finding v. When 
7 / we search for v of the form: 



v(t,x,i) = g(t,i) — , x > 0. 

7 



(4.32) 



When 7 = (logarithmic utility) we look for v of the form 

v(t, x, i) = g(t, i) log x + l(t, i), x > 0. (4.33) 

The functions g(t,i) and l(t,i) are to be found. In light of equations (|3. 15[) one gets 

/j,(t, i)x 



Fi(t,x,i) 



a2(M)(l-7) : 



F 2 (t,x,i) = g-y~ 1 (t,i)x. 



(4.34) 
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Note that the function l(t, i) does not enter the above equation so its expression is not important. 
By (|3.14p . the associated wealth process satisfies the following SDE: 



dX(s) 



^•■ j w» + ^il;»p- 7 ) -^('- j w> 



X(s)ds 



.x( s )dW(s). (4.35) 



a( S) J( S ))(l- 7 )- 

This is a linear SDE which can be easily solved. By plugging v of (|4.32p into (|3. 13[) (with F±, F2 of 
(|4.34p and X of (|4.35p . we obtain the following system of four equations for g(t,i),g(t,i), i £ S : 

-^(t, i) + [jr(t, i) + ^J" "_ - Pi ]g(t, i) + X ll9 (t, + -f)g— (t, i) = -X^git, j), (4.36) 

^(t, i) + [jr(t, i) + ^ - - Pj ]g{t, i) + X u g(t, i) + (1 - 7)^ (*, *) = -*U9(t,j), 

(4.37) 

with the final condition g(T,i) = g(T,i) = 1, i £ <S. Next we show that there exists a unique 
solution for this ODE system. Let us summarize 

Lemma 4.1. There exists a unique continuously differentiable uniformly bounded solution 
g(t,i),g(t,i), i € 5 for the system J^.fffip and |^.37| ). Furthermore, v(t,x,i) = g(t,i)— is a value 
function, meaning that v is continuously differentiable, concave in x and satisfies (I3.13P with 
F U F 2 of {£3$ and X of ggf . 

Appendix A. proves this Lemma. 

□ 

Theorem 4.2. T/ie trading strategy {tt(s), c(s)} sS [o ) t] given by 

*W = Jf' 7/ wf (g lv ^) = ^M'))*W> (4-38) 

cH(s, J(s))(l -7) 

is a subgame perfect strategy. 

Proof: Let us notice that the boundedness of 5 and the fact that X of (|4.35p is positive and it 
has finite moments of any order imply the acceptability of {7f(s), c(s)} se [o,T]- Next, the conclusion 



follows from Theorem! 

□ 

Remark 4.3. In the case of constant discount rate, i.e., po = pi, the subgame perfect strategies 
coincide with the optimal ones. This can be seen by looking at the equation (|3.20p which is 
exactly HJB (|2.6p ( after the first order conditions are implemented and by using v = v ( see (|3.18p 
and (\3.19\i ). The optimal investment and consumption problem is solved in closed form by J3J/ 
within this framework. 
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Remark 4.4. The subgame perefect investment strategy does not change relative to the Merton 
model with constant discount rate; more precisely the proportion of wealth invested in the stocks 
is the same as in the case of Merton model with constant discount rate. This can be explained by 
the randomness of market coefficients being driven by the Markov chain only. We conjecture that 
in a model with mean reverting market price of risk this result does not hold. 

Remark 4.5. There are three important trading strategies: 

• the subgame perfect strategy {tt (s), c(s)} sg [ 0j r] (with associated wealth process {X (s)} s e[o,T] 
) given by 

, , u(s,J(s))X(s) _. . . . 

a 2 (s, J(s))(l -7) 

• two pre- commitment strategies corresponding to the two discount rates po, p\ (with associated 
wealth process {^Oc(s)}.5e[o,T]> k = 1,2 ) which are optimal at time 0, but fail to remain 
optimal afterwards; they are given by 

A p{s,J(s))X k (s) „ - 

a z (s, J (s) 1 -7 



Ziere gk(t,i), i,j E S, k = 1,2 solve: 
— (M) + [7r(M)+ 2(j2(M)(1 _ 7) 



— (M) + [7 r (M)+ ^ 2 ^ — ^-po]gi(t^) + Au5i(t,i) + (l-7)5 1 7_1 (t,z) = -Xijgi(t,j), 

(4.39) 

t(t,j), 
(4.40) 



(t, ft) + [TT (t, + 2 ^ 2 ^ ^' ^ ^ , - pl]ff2 (t, + (t , + (1 ~ 7)ff2 = -^ijh{t,j) 

with boundary condition gi(T,i) = gi(T,i), i € <S. 
• a naive strategy that switches in between the two pre- commitment strategies. 

5 Numerical Analysis 

In this section, we use Matlab's powerful ODE solvers (especially the functions ode23 and ode45) 
to perform numerical experiments. We numerically solve ODE systems (|4.36p . (|4.39p and (|4.40p 
to get the subgame perfect and pre-commitment strategies. We take the Markov Chain generator 
to be 

f" 2 2 ) 

y 1.5 -1.5 J 

We plot the subgame perfect and pre-commitment consumption rates denoted by 
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C k (t, J(t)) 4 ^ = ^ J( i ))) fc = lt 2 . 

Fig. 1. Subgame perfect and pre-commitment consumption rates for po = 0.1, pi = 0.1, do = 
0.2, <7i = 0.2, ro = 0.05, ri = 0.05; the discount rates po = 0.3, pi = 0.06. 

Fig. 2. Subgame perfect and pre-commitment consumption rates for po = 0.1, pi = 0.1, do = 
0.2, (j i = 0.2, r = 0.01, ri = 0.09; the discount rates p = 0.07, pi = 0.06. 

Remark 5.1. Numerical findings reveal the complex dependence of the subgame perfect and pre- 
commitment consumption rates on the model parameters. In figure 1 we have the same market 
coefficients on the two states and a higher discount rate on the first state. This leads to higher 
subgame perfect consumption rate in the first state (in figure 1 notice that C(t,l) = ^(t, 0) = 
C/2(t, 1). In figure 2 we also let the interest rate depend on the regime. Here although 

po = 0.07 > pi = 0.06, 

C(t, 1) > C(t,0). The difference between different consumption rates becomes more pronounced 
for higher 7. 



6 Appendix 

6.1 A. Proof of Lemma 14.11 

Existence and uniqueness for the ODE system is granted locally in time. For global existence and 
uniqueness we eastablish global estimates. Let a(t,i) = — ^r{t,i) + 2a'^(tl)(i-^) — P» + ^»» >* ^ 
S, and a(t, i) = — jr(t, i) + 2a ¥(t% l (i-'y) ~ Pi ^ u e Then from the ODE system we get 

— (t, i) - a(t, i)g(t, i) < 0, — (t, i) - a(t, i)g(t, i) < 0, i G S. 

Integrating this from t to T and using g(T,i) = g(T,i) = l,i G <S we get a global lower bound 
M > for g, g. Next, since 7 < 1, from the ODE system 



:(t,i) > (a(t,i) - (I-t)M^MM) - Xijg(tJ),i,j e S, 

Y 

> (a(t,i)-(l- 7 )M^)^,i)-A^(M),i,ie5. 



dt 
dg_ 
dt 

Let - min(a(t,i) - (1 - 7)M^i,a(t, j) - (1 - 7)M^i), X(iJ) = max (A*,-, A,;). Let 

= g(t,i) + g(t,j). Then by adding the above inequalities we get 

dh 

— (i) > (A(t,i,j)-A(i,j))/i(t). 

Integrating this from t to T yields the desired upper bound. 

Recall that v(t,x,i) = g(t,i)—, and define v by v(t,x,i) = g(t,i)^-. Then it can be easily 
shown that (v,v) solves (|3.20p . (|3.2ip . Then by Lemma [3731 v satisfies f|3. 13j) . 
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